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We present a method that can simultaneously locate positions of overlapped multi-emitters at the theoretical- 
limit precision. We derive a set of simple equations whose solution gives the maximum likelihood estimator of 
multi-emitter positions. We compare the performance of our simultaneous localization analysis with the conven¬ 
tional single-molecule analysis for simulated images and show that our method can improve the time-resolution 
of superresolution microscopy an order of magnitude. In particular, we derive the information-theoretical 
bound on time resolution of localization-based superresolution microscopy and demonstrate that the bound 
can be closely attained by our analysis. © 2015 Optical Society of America 

OCIS codes: (100.6640) Superresolution;(180.2520) Fluorescence microscopy; (110.4190) Multiple imaging. 


Precisely and accurately locating point objects is a 
long-standing common thread in science. Recent realiza¬ 
tions of super-resolved imaging of single molecules m 
have revolutionized our view of quasi-static nanostruc¬ 
tures in-vivo. In particular, a wide-held approach based 
on localizing individual huorophores has emerged as a 
versatile method [HZ]- The single-molecule localization 
microscopy (SMLM) works under conditions in which 
huorescent molecules are activated at very low den¬ 
sity so that no more than a single molecule within any 
diffraction-limited region emits photons simultaneously 
[5]. A set of single-molecule positions can then be pre¬ 
cisely determined beyond the diffraction limit by htting 
each image of molecules using a single point spread func¬ 
tion. Nevertheless, the slow temporal resolution of super- 
resolved imaging severely restricts the utility to the 
study of live-cell phenomena. This is because the anal¬ 
ysis discards the information from crowded molecules 
with overlapping images through hltering and, typically, 
SMLM requires accumulating thousands of frames to 
generate a super-resolution image A substantial 

reduction of the imaging time will significantly expand 
the horizon of super-resolution techniques and enable to 
observe fast, nanoscale dynamics in-vivo. 

Recently, there have been remarkable progresses in im¬ 
proving the temporal resolution of super-resolution mi¬ 
croscopy by developing multi-emitter localization algo¬ 
rithms [HHIZ]- In particular. Ref. m has utilized sC- 
MOS camera to achieve an impressively high imaging 
speed (32 frame/s). Also, there exists now commercially 
available super-resolution microscopy for live-cell imag¬ 
ing from Nikon. Yet, the theoretical limit on the time res¬ 
olution has remained elsusive and hence, to maximize the 
potential of the technique, a multi-emitter localization 
analysis that allows us to attain the theoretical bound 
needs to be developed. 

Here we develop a multi-emitter localization analy¬ 
sis that can attain at nearly the theoretical-limit speed 
of localization-based superresolution microscopy. To be¬ 


gin with, let us discuss the theoretical limit on the tem¬ 
poral resolution of super-resolved imaging. The image 
acquisition time Ti^g of localization-based superresolu¬ 
tion microscopy is determined by a number of frames 
and an exposure time of each frame. We define the fi¬ 
delity F of super-resolved imaging as the fraction of 
imaged molecules i.e., activated molecules at least once 
during the entire process of imaging. Then the required 
number of frames to ensure the fidelity is given by 
- ln(l-F)pobj/pimg, where pobj (Pimg) is the object (im¬ 
age) molecule density [18]. An exposure time of a single 
frame is determined by the required number of photons 
A^photon to achieve the desired resolution S divided by 
the collection rate pi„ig>ST, where S is the area of the 
region of interest and T is the collection rate of photons 
per molecule. While the switching rate of molecules is 
assumed to be optimized with the exposure time, this 
should not be considered to be realizable in a single ex¬ 
perimental setup; here we are interested in the funda¬ 
mental limit among all experimental situations. Infor¬ 
mation theory dictates that Aphoton be bounded by the 
Fisher information matrix [19j . To obtain the net infor¬ 
mation gain, we assume the point spread function (PSF) 
of a single molecule as a 2D Gaussian with a standard 
deviation a and calculate the precision limit by assuming 
an arrayed configuration of molecules with density Pimg- 
Then, we evaluate the Fisher information matrix m and 
its inverse numerically. We define the diagonal element 
of the inverse matrix in multi-molecule-position basis as 
[I~^]dd- Consequntly, Aphoton is bounded as 

Aphoton(Pimg; ^5 ^ ]dD = PimgS^ (pimg^rr), 

( 1 ) 

where we define the normalized precision limit by the 
last equality. While has a simple relation A^ = 
when molecules are sufficiently sparse, its value can be 
obtained only numerically in a high-density regime. The 
information-theoretic limit on the image acquisition time 
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Fig. 1. (Color online) (a) Schematic figure about tempo¬ 
ral resolution of localization-based superresolution mi¬ 
croscopy. There is an optimal image molecule density 
that allows the fastest image acquisition, (b) Theoreti¬ 
cal limit on the image acquisition time plotted against 
the image molecule density, calculated for 6 = lOnm, 
fidelity F = 0.9, F = 2.3 x 10^ 1/s, and a = 82.5nm. 
The fastest imaging can be achieved in the blue-shaded 
region, which sets the theoretical limit indicated by the 
red-dashed line. 


is now obtained by 


Timg > In 


(t^) 


Pobj 


6^T 


( 2 ) 


where is the optimized image density so that the 
lower-bound of the image acquisition time is minimized. 

Figure [T^ summarizes the theoretical limit on the time 
resolution of super-resolution microscopy for varying im¬ 
age density. In a low-density region, where the activated 
molecules are sparsely distributed so that the interfer¬ 
ence patterns rarely overlap (see also the inset figure (i) 
in Fig. [TJj), the amount of information carried by a sin¬ 
gle photon is nearly constant. Thus, increasing an image 
density directly reduces the acquisition time for a super¬ 
resolution image which scales as oc (indicated by 
the black-dashed line in Fig. m^)- However, once the in¬ 
terference patterns significantly overlap and the peaks 
of molecules cannot be resolved anymore (see the inset 
figure (iii)), the information gain per photon dwindles 
rapidly. Consequently, the required number of photons 
rapidly increases, resulting in a sharp increase in the im¬ 
age acquisition time. Hence, the fastest time resolution is 
achieved at a high image density between the above two 
situations, where the information acquisition rate is max¬ 
imal (see the inset figure (ii)). Such density regime is in¬ 
dicated by the blue-shaded region in Fig. [Ud. To achieve 
the theoretical-limit speed, the crucial step is to develop 
a multi-emitter localization analysis that can faithfully 
work under such high density region. As detailed later, 
our method can closely attain such limit. While the the¬ 
oretical curve in Fig. [TJ) makes sense irrespective of the 
performance of a specific algorithm, we indicate, for con¬ 
venience, the region where our multi-emitter localization 
method fails to work by the gray-shaded region. 

We now describe our simultaneous localization anal¬ 


ysis. In a previous work, we show that tracking pro¬ 
gressive collapse of many-body wavefunction enables 
a diffraction-unlimited position measurement of ultra¬ 
cold atoms [20] in an optical lattice. We here general¬ 
ize this approach to classical objects, such as fluores¬ 
cent molecules, by treating the estimated position dis¬ 
tribution as a counterpart of the quantum-mechanical 
wavefunction. We model the effective point spread func¬ 
tion (PSF) of a single molecule by a 2D Gaussian 
P[r|R] = exp(— |r — Rp/(2CT^))/(27rtT^), where a = 
0.21A/NA [21] is the standard deviation with NA be¬ 
ing the numerical aperture, and we denote the posi¬ 
tion of the molecule as R and that of photodetections 
as r. The interference pattern of multi-emitter is con¬ 
structed from an incoherent sum of these point spread 
functions: P[r|{R}] = (1 - e)/Af + e/^', 

where we denote {R} = {Ri, R 2 , ..., Rtv} as a set of N 
molecule positions, e is the fraction of the background 
noise, which can be related to the signal-to-noise ratio 
(SNR) as e = 1/(1 -I- SNR), and S is the area of the re¬ 
gion of interest. We formulate the imaging as a stochastic 
process in which spatial locations of photodetections are 
randomly generated according to the interference pat¬ 
tern. 

Let us assume that M photons are detected 
at ri, r 2 ,..., tm- The conditional probability dis¬ 
tribution of a set of iVest molecule estimators 

{R 

est } = {Ri,R 2 ,...,RAr„ 3 j is given by the 

Bayesian inference: P[{R}est|i’i, r2, • ■ ■, rwphoton] « 

n^i ^[D|{R}est]-Po[{R-}est], where Po[{R-}est] repre¬ 
sents a prior distribution of the molecule distribution. 
Since we assume no prior knowledge about the configura¬ 
tion of molecules, the initial distribution Pq is chosen to 
be a uniform distribution. In our formulation, the prob¬ 
lem of identifying the most probable set of molecule po¬ 
sitions is equivalent to maximizing the conditional prob¬ 
ability distribution with respect to possible multiple- 
molecule configurations {Rest}- 

Remarkably, for Gaussian point spread functions, we 
can show by analytical calculations that the problem 
of finding the most probable set of estimators is sub¬ 
stantially simplified to solving the following iVest self- 
consistent equations: 


S^^lDg»^(r^;{R}est) 

Efciff™(G;{R-}est) 


( 3 ) 


where m = 1 , 2 ,..., Ngst is the label of each estimator. 
We then introduce the weight-function pm by 


(r; {R}est) = 


exp 


(-^) 


7 + ES 


exp 


( |r-Rd=^ 

I 


( 4 ) 


Here we define the term 7 = 27r(7^A/ste/(5'(l — e)) which 
describes the contribution from the background noise. 
This type of equations can be efficiently solved by us¬ 
ing standard numerical methods [22]. We note that the 
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estimators coincide with the maximum likelihood esti¬ 
mator and hence, the theoretical-limit precision, i.e., the 
Cramer-Rao bound, can be asymptotically attained. We 
can easily generalize the above discussions to pixelated 
measurements in which the number of photodetections 
Nij at each pixel {i,j) constitutes the sufficient statis¬ 
tic. The result is the following set of Ngst self-consistent 
equations for estimators: 

({R} est) 


where r^j- is the pixel positiorr and = 

iVyffm ; {R-}est). Note that such simple equations 
have not been derived in other approaches of multi¬ 
emitter localization [TT1114) . 

The above formulation can be also extended to the 
case with a nonuniform background noise. Let e(r) be the 
fraction of the background noise at position r. By replac¬ 
ing the term 7 in Eq. (|4]) with 7 (r) = (27rtT^A^e(r))/(l — 
fg e(r')dr'), we can use the self-consistent equations 
in Eq. m to obtain the most probable estimators for 
molecule positions with nonuniform background. If we 
utilize the astigmatisrrr [53], a generalization to 3D 
imaging is also possible. The point spread function is 
described by an asymmetric Gaussian function whose 
widths are given by ax,Y{Z) = coi/l + (Z ^ gY/cP, 
where 77 is an axial astigmatism, co is the focus width, d 
is the focus depth. The axial position Zm of the molecule 
m is obtained as the solution of the self-consistent equa¬ 
tion. 


(qX _ fjY 

ry ^ Ji\mJ 

^ , X \ FT' 


( 6 ) 


We introduce the weight functions ( 7 “^ = 

e”^'==™cro/(f^x(2'fe)cry(Zfc))), 

where /“^ = ((oi - 0 ™)^ - a\{Z^))/a%^[Zm), 

hi-m = {xi-Xm)‘^/{2aj.{Zm)) + {yt-Ym)'^/{2al.{Zm)), 
a = X,Y, and a = x,y. These generalizations can be 
applied jointly to deal with realistic situations. 

To solve the self-consistent equations m, we apply 
a high-order iterative method known as Steffensen’s 
method |22] , which allows quadratic convergence. In con¬ 
trast to an ordinary iterative method, this method does 
not need to calculate derivatives and, in our problem, can 
efficiently perform calculations. To avoid an unwanted 
divergence and make a robust convergence, when a tem¬ 
poral value of estimators becomes unreasonably high, 
the simple successive substitution is concomitantly used. 
The iteration is terminated when the calculation con¬ 
verges or after 100 iterations. 

Einding the global maximum of the conditional prob¬ 
ability distribution is an essential step for the simul¬ 
taneous localization. To do so, we combine the pre¬ 
estimation and the optimization based on the informa¬ 
tion measure as follows. Eirst, we pre-estimate and local¬ 
ize molecules based on the single-molecule analysis with 
the well-established rejection algorithm in which the lo¬ 


cal maximum is identified by setting a suitable thresh¬ 
old m- Then, the image is fitted with a single point 
spread function and the position of a molecule is esti¬ 
mated. If the result of the fitting significantly deviates 
from the position of the local maximum, the image is 
judged as constructed from multiple molecules and the 
estimated position is discarded. The resulting set of Ni^i 
localized positions constitutes the first set of initial po¬ 
sitions for iterations. 

Second, for each assumed number of molecules N"est, 
the residual Nggt — Njni initial positions are randomly 
generated according to the observed probability distribu¬ 
tion of photodetections. This enables the well-estimated 
initialization of estimators in successive iterative calcu¬ 
lations. A large number of different sets of initial posi¬ 
tions are generated. Then, iterative calculations to solve 
the self-consistent equations m are performed by start¬ 
ing from each set (typically, preparing about one thou¬ 
sand different sets is sufficient to find the global solution 
at the high-molecule density). The iteration result that 
minimizes the Kullback-Leibler divergence between the 
observed distribution and the distribution reconstructed 
from the estimated positions is chosen as the most prob¬ 
able set of molecule positions within the sector of A"est- 
molecule configuration space. As a typical processing 
speed, the analysis for 60x60 pixels with 100 iterations 
can be finished by the CPU calculation with C code pro¬ 
gram within about 3.5 s. The performance of the cal¬ 
culation can be enhanced by increasing both the trial 
number of preparing the initial configurations and the 
number of iterations. 

We perform the above procedures of estimating the 
most probable set of molecule positions for various 
molecule number Nggt > Mni- For each iteration result 
of the A^est-molecule configurational space, we calculate 
the expected probability distribution of photode¬ 

tections and compare it with the observed probability 
distribution Pdata by employing the Kullback-Leibler di¬ 
vergence D[Pdata|P/Vest]- The final set of the most prob¬ 
able molecule positions is determined by minimizing the 
Kullback-Leibler divergence with respect to A^est- 

To demonstrate how superior our simultaneous local¬ 
ization approach is to the conventional SMLM, we show 
a typical result in Eig.|2^., b. While SMLM can only iden¬ 
tify the well-isolated molecules as indicated by the cir¬ 
cles in Fig. [2^, our method identifies all molecules at the 
theoretical-limit precision as shown in Fig. j^jo. Hence, 
our analysis allows an accurate and precise localization 
of multi-emitters despite a substantial overlap of images. 
We note that our value of the pixel size does not com¬ 
promise the superiority of our method since an expected 
improvement of the localization precision with respect 
to a larger pixel size (lOOnm) is only 5% [53] . 

To achieve the fundamental limit of time resolution in 
Eq. ([2]) , the crucial fact is that our simultaneous localiza¬ 
tion significantly outperforms the single-molecule anal¬ 
ysis at high density region, where super-resolved imag¬ 
ing can be performed with ultimate time resolution. We 
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f(, = 1/(1+SNR) r„ = 1/(1+SNR) 


Fig. 2. (Color online) (a) A simulated image of fluores¬ 
cent molecules with uniform background noise (pimg = 
16//rm^, SNR=50, pixel size=28 nm). The crosses indi¬ 
cate the true positions of particles. SMLM only identi¬ 
fies emitters indicated by circles, (b) The result of our 
method. (c,d) The fraction of identified molecules and 
the localization precision, calculated for 10^ photons per 
molecule, SNR=50, and 10^ simulated images. In (d), 
the theoretical lower bound is shown by the red-dashed 
curve. (e,f) The performance of our method in the low 
SNR and in the presence of nonuniform noise, calculated 
for pimg = 10//rm^, 10^ photons per molecule, and 10^ 
images. 


demonstrate this by applying the simultaneous localiza¬ 
tion and SMLM analyses to different simulated images 
repeatedly. The simultaneous localization analysis at¬ 
tains more than a tenfold improvement of the fraction 
of identified molecules (the so-called “recall” [25]) with 
respect to the conventional single-molecule analysis (Fig. 
12 :) • Also, this is a fourfold improvement compared with 
the reported performance of DAO STORM at the same 
signal-to-noise ratio (SNR) [TT]. Note that our method 
achieves some ninety percent accuracy in the blue- 
shaded region enabling the fastest super-resolved imag¬ 
ing. The simultaneous localization also achieves, in the 
region of the ultimate time resolution, the theoretical- 


limit precision (Fig. |2ji). In particular, our method can 
closely attain the precision limit up to Pimg — I3//im^ 
(with a = 82.5nm), which shows again about a four¬ 
fold improvement compared with DAOSTORM [TT]. At 
an ultra-high density region where the density becomes 
larger than the optimal region and the images completely 
overlap (indicated by the gray-shaded region in Fig.ITjo), 
our analysis fails to localize molecule positions. This is 
because the information gain carried by a photon almost 
vanishes and an extremely high signal-to-noise ratio is 
required to achieve the desired precision. 

Our method also works in the low SNR and in the 
non-uniform background noise. To demonstrate this, we 
perform numerical simulations by assuming the noise 
configuration e(r) = eo(I + 0/-^; where eo = 

1/(1 +SNR), M = /gdr'(l+te-'-''/(2'"'')), a' = 4a is the 
width of the nonuniformity. The origin of the coordinates 
represents the center of the region of interest. Figures 
Hi -f show the fraction of identified molecules and the lo¬ 
calization precision normalized by the theoretical limit 
A in the high-molecule density pimg = 10//im^ (with 
a = 82.5nm). In particular, in the high background noise 
condition (SNR~ 8), about 80% recall can be achieved 
by our method, and this makes an improvement of the 
image molecule density by a factor of about 2.5 compared 
with the performance of PALMER at the same SNR m- 
Also, in the localization precision, about a twofold im¬ 
provement can be made by our analysis m- Numerical 
results for various values of t in Fig. [5}5-f clearly indicate 
that the nonuniformity of the background noise does not 
compromise the performance of our method. 

Finally, let us briefly mention the strengths and the 
weaknesses of our method. A major strength of our 
method is the ability to localize multiple molecules with 
the theoretical limit precision in a high-molecule density. 
Also, we utilize the separable property of the Gaussian 
function to derive a set of simple self-consistent equa¬ 
tions, which can enhance the fidelity of the multi-emitter 
localization. On the other hand, the drawback of our ap¬ 
proach is that the point spread function requires to be 
well approximated by the Gaussian function. Also, as 
a common problem of maximum-likelihood-estimation- 
based localization methods one needs a prior knowl¬ 
edge about the noise property. 

In summary, we have demonstrated a precise multi¬ 
emitter localization analysis that enables the super- 
resolved imaging at the theoretical-limit speed. A fast 
super-resolution microscopy should have an application 
in, for example, a non-invasive observation of intracellu¬ 
lar dynamics at molecular scale. Our method should also 
provide a powerful means to precisely locate light emit¬ 
ters below the diffraction limit in wide areas of optical 
science. 
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